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Abstract 

Local Stereo Matching methods have been attracting 
more attention recently because they are faster and more 
suitable for real-time applications. In this paper, we pro- 
pose a novel Sparse Locally Adaptive Cost aggregation 
(SLAC) local stereo matching method in order to improve 
the disparity accuracy while preserving fast computation 
speed. The proposed method consists of a fast initial cost 
aggregation stage followed by a refined cost aggregation 
that is only performed over a sparse subset of disparities. 
The cost aggregation is performed in a locally adaptive 
manner by adapting the support region to the local im- 
age intensity and structure. A novel sparse disparity sub- 
set selection method is proposed by assigning a significance 
status to candidate disparity values, and selecting the sig- 
nificant disparity values adaptively. Experimental results 
tested on Middlebury image sets show better disparity ac- 
curacy of the proposed method as compared to other recent 
local stereo methods. 

1. Introduction 

Disparity estimation using a stereo image pair has been 
thoroughly studied in computer vision. According to the 
survey in Q, there are two broad categories of stereo 
matching algorithms: global methods mmm and local 
methods 0 a Ei 0 a. Local stereo matching methods 
are much faster and more suitable for real-time applications. 
Recent local stereo matching methods lf72l l2ll4lT5ll9llT0ll3l 
generate more accurate disparity maps that outperform 
many global optimization based algorithms. Thus local 
stereo matching methods have been attracting more atten- 
tion recently. 

In local methods, the cost aggregation steps can affect 
significantly the disparity accuracy. Recent local methods 
perform cost aggregation using locally adaptive filtering 
techniques with region of support and weights that adapt 
to the local image characteristics. Using a guided filter for 
stereo matching was adopted in several stereo matching ap- 
proaches ® me nail. The guided filter is more suit- 
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able for real-time applications due to the linear computa- 
tion and the speed-up implementation using integral image 
methods. The adaptive support window methods can also 
improve the cost aggregation accuracy, thus benefiting the 
disparity estimation. An efficient adaptive support window 
approach called the cross-based support region method was 
firstly proposed in IT3l . and has been adopted in several re- 
cent stereo matching methods nmtsm This method can 
handle the variant shapes near depth discontinuities more 
accurately and its cost aggregation is more efficient as com- 
pared to other adaptive support window methods. 

In local stereo matching methods, it is important to re- 
duce the computational complexity of cost aggregation for 
real-time purposes, while retaining the accuracy of the es- 
timated disparities. There are several local stereo matching 
schemes trying to reduce the computational load and the 
aggregation redundancy El. The method proposed in 
© presents a fast box-filtered cost volume computation to 
reduce the redundancy using a disparity subset determined 
jointly from the disparity histogram and a sampling tech- 
nique in a square support region. But the fast box-filtered 
cost volume computation of © is noisy and inaccurate, 
since it makes use of a fixed squared support region that 
does not adapt to the local image characteristics. Another 
drawback of the method in © is that it adopts a bilateral 
adaptive weight calculation with a relatively high computa- 
tional cost. 

2. Contribution and Experimental Results 

We propose a novel Sparse Locally Adaptive Cost aggre- 
gation (SLAC) local stereo matching method. The proposed 
SLAC local stereo matching method consists of a fast initial 
cost aggregation stage followed by a refined cost aggrega- 
tion that is only performed over a sparse subset of dispar- 
ities. In the proposed method, the support region is calcu- 
lated in a locally adaptive manner by adapting the support 
region to the local image intensity and structure. We pro- 
pose a locally adaptive cross-based support region calcula- 
tion method that incorporates the variance of the local color 
change at each pixel in the color similarity threshold. In or- 
der to reduce outlier disparity values that correspond to mis- 
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1.12 
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1.04 

1.53 

5.62 
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0.38 

2.15 


Algorithm 

Teddy 

Cones 

APBP 


Nonocc 

All 

Disc 

Nonocc 

All 

Disc 

(%) 

Proposed 

4.91 

10.20 

13.31 

2.45 

8.39 

7.11 

4.78 

AdaptiveGF 

5.71 

11.3 

14.3 

2.44 

8.22 

7.05 

4.98 

HistAggr2 

5.88 

11.3 

14.7 

2.41 

8.18 

7.21 

5.20 

CrossLMF 

5.50 

10.6 

14.2 

2.34 

7.82 

6.80 

5.13 


Table 1. Bad pixel error of the proposed stereo matching algorithm 
based on the Middlebury stereo evaluation benchmark version 2, 
and comparison with existing local stereo matching methods. 

matching, a novel sparse disparity subset selection method 
is also proposed by assigning a significance status to candi- 
date disparity values, and selecting the significant disparity 
values adaptively. For this purpose, a fast cost aggregation 
is conducted first to generate an initial coarse aggregated 
cost volume for all pixels at all disparity levels, and then a 
sparse disparity subset is estimated from the initial coarse 
aggergated cost volume for each pixel by adaptively select- 
ing both the local minima and neighborhood points near lo- 
cal minima of initial aggregated matching cost. An adaptive 
guided filtering method is proposed based on the estimate 
sparse disparity subset to generate the refined aggregated 
cost volume. Finally, the disparity maps are calculated us- 
ing a winner-take-all method and are refined through occlu- 
sion handling and post-processing steps a. 

The proposed stereo matching algorithm is tested on 
Middlebury stereo evaluation benchmark images. The bad 
pixel error of the resulting disparity maps for different 
datasets are shown in Table [I] The experimental results 
show that the proposed method produces disparity results 
with lower disparity bad pixel errors compared with existing 
local stereo matching methods 0 [lO] JT3j| ■ Further results 
also show that using the estimated sparse disparity subset 
for cost aggregation performs better than using the full dis- 
parity range. 

3. Conclusion 

In this paper, we we propose a novel Sparse Locally 
Adaptive Cost aggregation (SLAC) local stereo matching 
method. We propose a novel cost aggregation method per- 
formed in a locally adaptive manner by adapting the sup- 
port region to the local image intensity and structure, using 
the robustly estimated disparity subset and adaptive guided 
filter weights. The experimental results show that the pro- 
posed method outperforms most recent local stereo match- 
ing algorithms 0Q3Q1, and is capable to achieve state-of- 
the-art disparity results while preserving linear computation 


efficiency. 
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